Unsupervised training of an HMM-based self-organizing unit recognizer with applications to topic classification and keyword discovery

We present our approach to unsupervised training of speech recognizers. Our approach iteratively adjusts sound units that are ptimized for the acoustic domain of interest. We thus enable the use of speech recognizers for applications in speech domains here transcriptions do not exist. The resulting recognizer is a state-of-the-art recognizer on the optimized units. Specifically we ropose building HMM-based speech recognizers without transcribed data by formulating the HMM training as an optimization ver both the parameter and transcription sequence space. Audio is then transcribed into these self-organizing units (SOUs). We escribe how SOU training can be easily implemented using existing HMM recognition tools. We tested the effectiveness of SOUs n the task of topic classification on the Switchboard and Fisher corpora. On the Switchboard corpus, the unsupervised HMM-based OU recognizer, initialized with a segmental tokenizer, performed competitively with an HMM-based phoneme recognizer trained ith 1 h of transcribed data, and outperformed the Brno University of Technology (BUT) Hungarian phoneme recognizer (Schwartz t al., 2004). We also report improvements, including the use of context dependent acoustic models and lattice-based features, hat together reduce the topic verification equal error rate from 12% to 7%. In addition to discussing the effectiveness of the SOU pproach, we describe how we analyzed some selected SOU n-grams and found that they were highly correlated with keywords, emonstrating the ability of the SOU technology to discover topic relevant keywords. 2013 Published by Elsevier Ltd.